Endoscope system

ABSTRACT

An endoscope system has an insertion portion, a front-view observation window that acquires a first object image, a side-view observation window that is provided in the insertion portion, and acquires a second object image, a video processor that generates a signal of an image, a setting storage section that records information on a deviation amount concerning a deviation, and an image processing section that performs, for the image, processing of changing disposition of at least either the image of the object in the first object image or the image of the object in the second object image in accordance with the deviation amount, and aligning a position of the image of the object in the first object image, and a position of the image of the object in the second object image with each other.

CROSS REFERENCE TO RELATED APPLICATION

This application is a continuation application of PCT/JP2015/053275filed on Feb. 5, 2015 and claims benefit of Japanese Application No.2014-026833 filed in Japan on Feb. 14, 2014, the entire contents ofwhich are incorporated herein by this reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an endoscope system, and particularlyrelates to an endoscope system capable of simultaneously observing afront-view direction and a side-view direction.

2. Description of the Related Art

Endoscope systems including endoscopes that pick up images of objectsinside a subject, image processing apparatuses that generate observationimages of the objects which are picked up by the endoscopes, and thelike are widely used in medical fields, industrial fields and the like.

For example, Japanese Patent No. 4955838 discloses an endoscope systemincluding an endoscope in which a protruding portion that protrudes froma distal end face of a distal end portion of an insertion portion isprovided, a front observation lens that observes a subject located at aforward side is provided at a distal end face of the protruding portion,and a circumferential observation lens that observes a subject locatedto face a circumference of the protruding portion is provided at thecircumference of the protruding portion.

The endoscope picks up an image of the subject observed by the forwardside observation lens in a circular region at a center portion of animage pickup device, and picks up an image of the subject observed bythe circumferential observation lens in a circular ring region at anouter circumference of the circular region of the same image pickupdevice. Thereby, an endoscopic image in which the forward side image isformed at the center portion as a circular front-view field of viewimage, and the image in a circumferential direction is formed in anouter circumferential portion of the front-view field of view image as aside-view field of view image in a circular ring shape is displayed on amonitor.

Further, Japanese Patent No. 3337682 discloses an endoscope systemincluding an endoscope in which a front-view observation lens thatacquires a front-view field of view image is provided on a distal endface of a distal end portion of an insertion portion, and a plurality ofside-view observation lenses that acquires a side-view field of viewimage are provided in a circumferential direction of the distal endportion.

The endoscope is provided with image pickup devices respectively inimage formation positions of the front-view observation lens and theplurality of side-view observation lenses, and picks up a front-viewfield of view image and a plurality of side-view field of view images bythe image pickup devices. Subsequently, the front-view field of viewimage is disposed in a center, and a plurality of side-view field ofview images are disposed on both sides of the front-view field of viewimage, which are displayed on a monitor.

When treatment instruments are inserted through the endoscopes disclosedin Japanese Patent No. 4955838 and Japanese Patent No. 3337682, slidesof the treatment instruments are observed in respective front-view fieldof view images and side-view field of view images.

SUMMARY OF THE INVENTION

An endoscope system of one aspect of the present invention includes aninsertion portion that is inserted to an inside of an object, a firstobject image acquisition section that is provided in the insertionportion, and acquires a first object image including an image of apredetermined object, from a first region of the object, a second objectimage acquisition section that is provided in the insertion portion, andacquires a second object image including the image of the object, from asecond region of the object, which at least partially differs from thefirst region, an image signal generation section that generates a signalof an image in which the first object image and the second object imageare disposed side by side so as to be adjacent to each other, arecording section that records information on a deviation amountconcerning a deviation of disposition of the image of the object in thefirst object image, and disposition of the image of the object in thesecond object image, in the image, and an image processing section thatperforms, for the image, processing of changing disposition of at leasteither the image of the object in the first object image and the imageof the object in the second object image in accordance with thedeviation amount, and aligning a position of the image of the object inthe first object image, and a position of the image of the object in thesecond object image with each other.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a view showing a configuration of an endoscope systemaccording to a first embodiment;

FIG. 2 is a perspective view showing a configuration of a distal endportion of an insertion portion of an endoscope;

FIG. 3 is a front view showing the configuration of the distal endportion of the insertion portion of the endoscope;

FIG. 4 is a diagram showing an example of an observation image displayedin a monitor;

FIG. 5 is a diagram showing a configuration of an essential part in thefirst embodiment;

FIG. 6 is a diagram showing a configuration of an image processingsection in the first embodiment;

FIG. 7A is a diagram showing an example of an observation imageincluding images of a treatment instrument displayed in the monitor;

FIG. 7B is a diagram showing an example of the observation imageincluding the images of the treatment instrument displayed in themonitor;

FIG. 7C is a diagram showing an example of the observation imageincluding the images of the treatment instrument displayed in themonitor;

FIG. 7D is a diagram showing an example of the observation imageincluding the images of the treatment instrument displayed in themonitor;

FIG. 7E is a diagram showing an example of the observation imageincluding the images of the treatment instrument displayed in themonitor;

FIG. 8 is a flowchart for explaining an example of image processing bythe image processing section of the first embodiment;

FIG. 9 is a perspective view showing a configuration of a distal endportion of an insertion portion of an endoscope according to a secondembodiment;

FIG. 10 is a diagram showing a configuration of an essential part in thesecond embodiment;

FIG. 11A is a diagram showing an example of an observation imageincluding images of a treatment instrument displayed in a monitor;

FIG. 11B is a diagram showing an example of the observation imageincluding images of the treatment instrument displayed in the monitors;

FIG. 12 is a diagram for explaining a configuration of an imageprocessing section according to a third embodiment;

FIG. 13A is a diagram showing an example of an observation imageincluding images of a treatment instrument displayed in a monitor;

FIG. 13B is a diagram showing an example of the observation imageincluding the images of the treatment instrument displayed in themonitor;

FIG. 13C is a diagram showing an example of the observation imageincluding the images of the treatment instrument displayed in themonitor;

FIG. 14 is a flowchart for explaining an example of image processing bythe image processing section of the third embodiment;

FIG. 15A is a diagram showing an example of the observation imageincluding the images of the treatment instrument displayed in themonitor;

FIG. 15B is a diagram showing an example of the observation imageincluding the images of the treatment instrument displayed in themonitor;

FIG. 16 is a flowchart for explaining an example of image processing byan image processing section of a fourth embodiment;

FIG. 17A is a diagram showing an example of an observation imageincluding images of a treatment instrument displayed in a monitor;

FIG. 17B is a diagram showing an example of the observation imageincluding the images of the treatment instrument displayed in themonitor;

FIG. 18 is a flowchart for explaining an example of image processing byan image processing section of a fifth embodiment;

FIG. 19A is a diagram showing an example of screen display on anoccasion of an endoscope system of the second embodiment being appliedto an endoscope system of the third embodiment;

FIG. 19B is an example in which an endoscope system 1 of the secondembodiment is applied to the endoscope system 1 of the fourthembodiment;

FIG. 19C is an example in which the endoscope system 1 of the secondembodiment is applied to the endoscope system 1 of the fifth embodiment;

FIG. 19D is an example in which the endoscope system 1 of the secondembodiment is applied to the endoscope system 1 in which the third, thefourth and the fifth embodiments are combined;

FIG. 19E is an example in which an image signal is displayed with aredundant portion being deleted from the image signal;

FIG. 20 is a perspective view of a distal end portion 6 of an insertionportion 4, to which a sideward side observation unit is attached; and

FIG. 21 is a diagram showing a configuration of an essential part in asixth embodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, embodiments of the present invention will be described withreference to the drawings.

First Embodiment

At first, a configuration of an endoscope system of a first embodimentwill be described with use of FIG. 1 to FIG. 8. FIG. 1 is a view showinga configuration of the endoscope system according to the firstembodiment. FIG. 2 is a perspective view showing a configuration of adistal end portion of an insertion portion of an endoscope. FIG. 3 is afront view showing the configuration of the distal end portion of theinsertion portion of the endoscope. FIG. 4 is a diagram showing anexample of an observation image displayed in a monitor. FIG. 5 is adiagram showing a configuration of an essential part in the firstembodiment. FIG. 6 is a diagram showing a configuration of an imageprocessing section in the first embodiment. FIG. 7A to FIG. 7E arediagrams each showing an example of the observation image includingimages of a treatment instrument displayed in the monitor. Further, FIG.8 is a flowchart for explaining an example of image processing.

As shown in FIG. 1, an endoscope system 1 has an endoscope 2 that picksup an image of an observation object and outputs an image pickup signal,a light source apparatus 31 that supplies illuminating light forilluminating an observation object, a video processor 32 having afunction as an image signal generation section that generates andoutputs a video signal (an image signal) corresponding to an imagepickup signal, and a monitor 35 that displays an observation imagecorresponding to a video signal (an image signal).

The endoscope 2 is configured by having an operation portion 3 for asurgeon to grasp to perform an operation, an elongated insertion portion4 that is formed at a distal end side of the operation portion 3 and isinserted into a body cavity or the like, and a universal cord 5 that hasone end portion provided to extend from a side portion of the operationportion 3.

The endoscope 2 of the present embodiment is a wide-angle endoscopecapable of observing a field of view of 180 degrees or more bydisplaying a plurality of field of view images, and realizes preventionof omission of a lesion of a location that is difficult to see only byobservation in a front-view direction, such as a back of a fold, aboundary of organs, or the like in a body cavity, in particular, in alarge intestine. When the insertion portion 4 of the endoscope 2 isinserted into a large intestine, actions occur, such as twisting, areciprocating motion, and temporary fixation by performing hooking on anintestinal wall, as in an ordinary colonoscope.

The insertion portion 4 is configured by having a rigid distal endportion 6 provided at a most distal end side, a bendable bending portion7 provided at a rear end of the distal end portion 6, and a flexibletube portion 8 that is provided at a rear end of the bending portion 7,and has a long length and flexibility. Further, the bending portion 7performs a bending action corresponding to an operation of a bendingoperation lever 9 provided at the operation portion 3.

As shown in FIG. 2, on the distal end portion 6 of the insertion portion4, a cylinder portion 10 in a circular column shape that is provided toprotrude from a position eccentric to an upper side from a center of adistal end face of the distal end portion 6 is formed.

An objective optical system not illustrated that is used for both afront view and a side view is provided at a distal end portion of thecylinder portion 10. Further, the distal end portion of the cylinderportion 10 is configured by having a front-view observation window 12that is disposed in a spot corresponding to a front-view direction ofthe aforementioned objective optical system not illustrated, and aside-view observation window 13 that is disposed in a spot correspondingto a side-view direction of the aforementioned objective optical systemnot illustrated. Furthermore, a side-view illumination section 14 thatemits light for illuminating the side-view direction is formed in avicinity of a proximal end of the cylinder portion 10.

The side-view observation window 13 includes a side-view mirror lens 15for enabling acquisition of a side-view field of view image by capturingreturn light (reflection light) from an observation object that isincident from a circumferential direction in the cylinder portion 10 inthe circular column shape, in a side-view field of view.

Note that (an image pickup face of) an image pickup device 30 shown inFIG. 5 is disposed in an image formation position of the aforementionedobjective optical system not illustrated, so that an image of anobservation object in a field of view of the front-view observationwindow 12 is formed in a center portion as a circular front-view fieldof view image, and an image of the observation object in a field of viewof the side-view observation window 13 is formed in an outercircumferential portion of the front-view field of view image as aside-view field of view image in a circular ring shape.

Such an image is realized by using a double reflection optical systemthat reflects returning light twice by the side-view mirror lens 15, butan image may be formed by returning light being reflected once by asingle reflection optical system, and is subjected to image processingby the video processor 32, and orientations of the side-view field ofview image and the front-view field of view image may be matched witheach other.

A front-view illuminating window 16 that is disposed in a positionadjacent to the cylinder portion 10 and emits illuminating light to arange of a front-view field of view of the front-view observation window12, and a distal end opening portion 17 that communicates with atreatment instrument channel not illustrated that is formed by a tube orthe like placed in the insertion portion 4, and enables (a distal endportion of) a treatment instrument inserted through the treatmentinstrument channel to protrude are provided on the distal end face ofthe distal end portion 6.

Further, the distal end portion 6 of the insertion portion 4 has asupport portion 18 that is provided to protrude from the distal end faceof the distal end portion 6, and the support portion 18 is locatedadjacently to a lower portion side of the cylinder portion 10.

The support portion 18 is configured to be able to support (or hold)respective protruding members that are disposed to be protruded from thedistal end face of the distal end portion 6. More specifically, thesupport portion 18 is configured to be able to support (or hold) afront-view observation window nozzle portion 19 that injects gas or aliquid for cleaning the front-view observation window 12, a front-viewilluminating window 21 that emits light for illuminating a front-viewdirection, and a side-view observation window nozzle portion 22 thatinjects gas or a liquid for cleaning the side-view observation window 13as the aforementioned respective protruding members, respectively.

The support portion 18 is formed by having a shielding portion 18 a thatis an optical shielding member for preventing a side-view field of viewimage that includes any of the respective protruding members from beingacquired by the aforementioned respective protruding members which aredifferent matters from an original observation object appearing in theside-view field of view. That is, the shielding portion 18 a is providedat the support portion 18, whereby a side-view field of view image inwhich none of the front-view observation window nozzle portion 19, thefront-view illuminating window 21 and the side-view observation windownozzle portion 22 is included, can be obtained.

As shown in FIG. 2 and FIG. 3, the side-view observation window nozzleportions 22 are provided at two spots at the support portion 18, and aredisposed on side faces of the support portion 18 so that distal endsprotrude.

As shown in FIG. 1, a gas/liquid feeding operation button 24 a capableof instructing an operation of causing gas or a liquid for cleaning thefront-view observation window 12 to be injected from the front-viewobservation window nozzle portion 19, and a gas/liquid feeding operationbutton 24 b capable of instructing an operation of causing gas or aliquid for cleaning the side-view observation window 13 to be injectedfrom the side-view observation window nozzle portion 22 are provided atthe operation portion 3, and gas feeding and liquid feeding areswitchable by depression of the gas/liquid feeding operation buttons 24a and 24 b. Further, in the present embodiment, the plurality ofgas/liquid feeding operation buttons are provided to correspond to therespective nozzle portions, but gas or a liquid may be caused to beinjected from both of the front-view observation window nozzle portion19 and the side-view observation window nozzle portion 22 by anoperation of one gas/liquid feeding operation button, for example.

A plurality of scope switches 25 are provided at a top portion of theoperation portion 3, and have configurations that can be assigned withfunctions according to the respective switches so as to be caused tooutput signals corresponding to on, off or the like of variousstatements usable in the endoscope 2. Specifically, the scope switches25 can be assigned with functions of being caused to output signalscorresponding to start and stop of forward side water feeding, executionand cancel of a freeze, notification of a use state of a treatmentinstrument and the like, as the functions according to the respectiveswitches.

Note that in the present embodiment, at least one of the functions ofthe gas/liquid feeding operation buttons 24 a and 24 b may be assignedto any one of the scope switches 25.

Further, at the operation portion 3, a suction operation button 26 isplaced, which is capable of performing an instruction for sucking andrecovering mucus or the like in a body cavity from the distal endopening portion 17 to a suction unit or the like not illustrated.

The mucus or the like in the body cavity which is sucked in accordancewith an action of the suction unit or the like not illustrated passesthrough the distal end opening portion 17, the treatment instrumentchannel not illustrated in the insertion portion 4, and a treatmentinstrument insertion port 27 provided in a vicinity of a front end ofthe operation portion 3, and thereafter is recovered into a suctionbottle or the like of the suction unit not illustrated.

The treatment instrument insertion port 27 is formed as an opening whichcommunicates with the treatment instrument channel not illustrated inthe insertion portion 4, and into which a treatment instrument notillustrated can be inserted. That is, a surgeon can perform treatmentusing a treatment instrument by inserting the treatment instrument fromthe treatment instrument insertion port 27, and causing a distal endside of the treatment instrument to protrude from the distal end openingportion 17.

As shown in FIG. 1, a connector 29 connectable to the light sourceapparatus 31 is provided at the other end portion of the universal cord5.

A pipe sleeve (not illustrated) to be a connection end portion of afluid conduit, and a light guide pipe sleeve (not illustrated) to be asupply end portion of illuminating light are provided at a distal endportion of the connector 29. Further, an electric contact point portion(not illustrated) to which one end portion of a connection cable 33 canbe connected is provided at a side face of the connector 29.Furthermore, a connector for electrically connecting the endoscope 2 andthe video processor 32 is provided at the other end portion of theconnection cable 33.

In the universal cord 5, a plurality of signal lines for transmittingvarious electric signals, and a light guide for transmitting theilluminating light supplied from the light source apparatus 31 areincorporated in a bundled state.

The aforementioned light guide which is incorporated in the insertionportion 4 through the universal cord 5 has an end portion at a lightexit side branched into at least two directions in a vicinity of theinsertion portion 4, and has such a configuration that a light exit endface at one side is disposed in the front-view illuminating windows 16and 21, and a light exit end face at the other side is disposed in theside-view illumination section 14. Further, the aforementioned lightguide has such a configuration as an end portion at a light incidentside is disposed in the light guide pipe sleeve of the connector 29.

Note that the light exit portions disposed in the front-viewilluminating windows 16 and 21 and the side-view illumination section 14may be light emitting devices such as a light emitting diode (LED) inplace of the light guide.

The video processor 32 outputs a drive signal for driving an imagepickup device provided at the distal end portion 6 of the endoscope 2.The video processor 32 functions as an image signal generation sectionthat generates a video signal (an image signal) by applying signalprocessing to an image pickup signal outputted from the aforementionedimage pickup device and outputs the video signal to the monitor 35.

Thereby, an observation image including a front-view field of view imageforming a circular shape, and a side-view field of view image forming acircular ring shape in an outer circumference of the image in afront-view direction, that is, an image in which the side-view field ofview image is arranged in such a manner as to enclose the front-viewfield of view image in a state where the side-view field of view imageis adjacent to the front-view field of view image is displayed in themonitor 35 in an aspect as shown in FIG. 4, for example. Note that ineach of the observation images shown in the present embodiment andfollowing embodiments, a part that is optically shielded by theshielding portion 18 a of the support portion 18 is not taken intoconsideration. Further, the front-view field of view image and theside-view field of view image which are displayed in the monitor 35 maybe respectively in other display aspects without being limited to thecircular shape and the circular ring shape shown in FIG. 4.

Peripheral apparatuses such as the light source apparatus 31, the videoprocessor 32 and the monitor 35 are disposed on a rack 36 together witha keyboard 34 that performs input of patient information, and the like.

As shown in FIG. 5, the video processor 32 is configured by having atleast an image processing section 32 a, and an image output section 32b.

The front-view observation window 12 configuring a first object imageacquisition section acquires a first object image from a front-viewdirection (a first direction) that is substantially parallel with alongitudinal direction of the insertion portion 4 and includes afrontward side, that is, a first region of an object, and the side-viewobservation window 13 configuring a second object image acquiringsection acquires a second object image from a side-view direction (asecond direction) that at least partially differs from the front-viewdirection (the first direction) and intersects the longitudinaldirection of the insertion portion 4, that is, a second region of theobject.

Note that a boundary region between the first object image and thesecond object image may be duplicate, or does not have to be duplicate,and in a case of a state where the above described boundary region isduplicate, duplicate object images may be acquired in the first objectimage acquiring section and the second object image acquiring section.

The image pickup device 30 photoelectrically converts the object imagein the front-view direction and the object image in the side-viewdirection on a same plane. The image pickup device 30 is electricallyconnected to the image processing section 32 a, and outputs the objectimages acquired in the front-view observation window 12 and theside-view observation window 13 to the image processing section 32 a.

The image processing section 32 a recognizes an image of a treatmentinstrument included in the front-view field of view image, and an imageof the treatment instrument included in the side-view field of viewimage. Subsequently, the image processing section 32 a generates animage signal with disposition changed with respect to at least eitherthe front-view field of view image and the side-view field of view imageso that a central axis of the image of the treatment instrument includedin the front-view field of view image, and a central axis of the imageof the treatment instrument included in the side-view field of viewimage substantially correspond to each other.

The image output section 32 b generates a signal to be displayed in themonitor 35 from the image signal generated by the image processingsection 32 a, and outputs the signal to the monitor 35.

As shown in FIG. 6, the image processing section 32 a is configured byhaving an image recognition section 41, a central axis recognitionsection 42, an image movement amount calculation section 43 and an imagegeneration section 44.

The image recognition section 41 recognizes an image of a predeterminedobject, for example, an image of a treatment instrument observed in aside-view field of view, and an image of the treatment instrumentobserved in a front-view field of view. For example, since a positionwhere the treatment instrument protrudes from the distal end openingportion 17 is fixed, the image recognition section 41 recognizes amatter which protrudes from a direction of the position and advances asthe treatment instrument. Alternatively, the image recognition section41 may recognize the treatment instrument by calculating a direction inwhich the treatment instrument slides from movement, or may recognizethe treatment instrument by recognizing a thickness and a contour of thetreatment instrument from an image contrast.

The central axis recognition section 42 calculates central axes ofrespective images from the image of the treatment instrument observed inthe side-view field of view and the image of the treatment instrumentobserved in the front-view field of view which are recognized by theimage recognition section 41, and recognizes the central axis. Forexample, as for the central axis, the central axis of the treatmentinstrument is recognized from the image contrast of the thickness of thetreatment instrument, and a moving direction in which the treatmentinstrument is protruded.

By performing the above processing, the object such as the treatmentinstrument included in the front-view field of view image, and theobject such as the treatment instrument included in the side-view fieldof view image are disposed in positions which are adjacent to each otherwithout unnaturalness.

The image movement amount calculation section 43 calculates an openingangle between the respective central axes from image centers (opticalaxis centers) of coordinate positions of the respective central axes,with respect to the images of the treatment instrument observed in thefront-view field of view and the side-view field of view.

The image generation section 44 recognizes a boundary between thefront-view field of view image and the side-view field of view image,cuts out only the side-view field of view image, rotationally moves theside-view field of view image with an image center as a starting pointon the basis of the opening angle calculated by the image movementamount calculation section 43 so that the coordinates of inclinations ofthe images of the treatment instrument correspond to each other, andgenerates an image signal with the central axis of the image of thetreatment instrument observed in the side-view field of view, and thecentral axis of the image of the treatment instrument observed in thefront-view field of view substantially corresponding to each other.

Note that the image generation section 44 may rotationally move thefront-view field of view image, or may rotationally move both of thefront-view field of view image and the side-view field of view image, sothat the image of the treatment instrument in the front-view field ofview image and the image of the treatment instrument in the side-viewfield of view image substantially correspond to each other.

For example, when an image 50 of the treatment instrument in thefront-view field of view image, and an image 51 of the treatmentinstrument in the side-view field of view image deviate from each otheras shown in FIG. 7A, the image generation section 44 causes central axesof the image 50 of the treatment instrument in the front-view field ofview image, and the image 51 of the treatment instrument in theside-view field of view image to substantially correspond to each otherby rotationally moving the side-view field of view image with the imagecenter as the starting point, as shown in FIG. 7D.

Note that the image generation section 44 may rotationally move thefront-view field of view image with an image center as the startingpoint as shown in FIG. 7E. Further, the image generation section 44 maycause the central axis of the image of the treatment instrument in thefront-view field of view image and the central axis of the image of thetreatment instrument in the side-view field of view image tosubstantially correspond to each other by rotationally moving both ofthe side-view field of view image and the front-view field of viewimage.

Next, an operation of the endoscope system 1 configured in this way willbe described.

FIG. 8 is a flowchart for explaining an example of image processing bythe image processing section of the present embodiment. Note that in theflowchart in FIG. 8, processing of rotationally moving the side-viewfield of view image with the image center as the starting point so as tocause the central axes of the treatment instrument to substantiallycorrespond to each other will be described, but the processing is notlimited to this. For example, processing of rotationally moving thefront-view field of view image with the image center as the startingpoint may be performed, or processing of rotationally moving both of thefront-view field of view image and the side-view field of view imagewith the image centers as the starting points may be performed.

When the treatment instrument is inserted through the treatmentinstrument channel first, and the treatment instrument protrudes fromthe distal end opening portion 17 (step S1), the image recognitionsection 41 recognizes the treatment instrument observed in the side-viewfield of view from the image (step S2). Next, as in FIG. 7B, the centralaxis recognition section 42 calculates the central axis of the image ofthe treatment instrument observed in the side-view field of view (stepS3).

When the treatment instrument further protrudes, the image of thetreatment instrument is observed in the front-view field of view.Thereupon, the image recognition section 41 recognizes the treatmentinstrument observed in the front-view field of view from the image (stepS4), and as in FIG. 7B, the central axis recognition section 42calculates the central axis of the image of the treatment instrumentobserved in the front-view field of view (step S5).

Next, as shown in FIG. 7C, the image movement amount calculation section43 calculates the opening angle between the respective central axes fromthe coordinate positions of the respective central axes (step S6). Theopening angle is a correction angle of the central axis of the image ofthe treatment instrument observed in the side-view field of view whichis parallel to the central axis of the image of the treatment instrumentobserved in the front-view field of view, which is calculated by theimage movement amount calculation section 43.

The image generation section 44 recognizes only the side-view field ofview image and cuts out only the side-view field of view image (stepS7). The image generation section 44 rotationally moves the side-viewfield of view image which is cut out with the image center as thestarting point so that inclinations of the respective central axes ofthe treatment instrument correspond to each other (step S8). Finally,the image generation section 44 generates the image signal with thecentral axis of the image of the treatment instrument in the front-viewfield of view image and the central axis of the image of the treatmentinstrument in the side-view field of view image substantiallycorresponding to each other (step S9), and ends processing. The imagesignal which is generated in this way is displayed in the monitor 35 viathe image output section 32 b.

As above, the endoscope system 1 detects a deviation between the imageof the treatment instrument of the front-view field of view image andthe image of the treatment instrument of the side-view field of viewimage, rotates the front-view field of view image or the side-view fieldof view image in accordance with an amount of the deviation, and causesthe central axes of the image of the treatment instrument in thefront-view field of view image and the image of the treatment instrumentin the side-view field of view image to substantially correspond to eachother. Thereby, the central axes of the images of the treatmentinstrument in the front-view field of view image and the side-view fieldof view image substantially correspond to each other, and therefore,visibility and operability of the treatment instrument can be enhanced.Further, since the front-view field of view image or the side-view fieldof view image is rotated with the image center as the starting point,the axes of the treatment instrument can be caused to correspond to eachother without sizes of the respective images and centers of therespective images being changed.

Consequently, according to the endoscope system of the presentembodiment, the objects (the images of the treatment instrument or thelike) within the field of view which is observed in the front-view fieldof view and the side-view field of view are caused to continue to eachother without time and effort in manufacturing and working an endoscopebeing increased, whereby workability of treatment by the treatmentinstrument under the endoscope having a plurality of fields of view canbe enhanced.

Note that as the images of the object the positions of which are causedto correspond to each other, the image of the object is not limited tothe treatment instrument, but may be another element such as a fold in abody cavity, or a stent or a clip dwelling in a body cavity, andpositioning may be performed by performing recognition of the objects inthe front-view field of view and the side-view field of view accordingto the procedure similar to the procedure described above, andperforming rotational movement of the front-view field of view or theside-view field of view.

Second Embodiment

Next, a second embodiment will be described.

FIG. 9 is a perspective view showing a configuration of a distal endportion of an insertion portion of an endoscope according to the secondembodiment.

As shown in FIG. 9, on a distal end face of a distal end portion 6 a ofan endoscope 2 a, a front-view observation window 60 a for observing afront-view direction (a first direction) that is substantially parallelwith the longitudinal direction of the insertion portion 4 and includesa forward side, that is, a first region of an object is disposed, and ona side face of the distal end portion 6 a of the endoscope 2 a,side-view observation windows 60 b and 60 c for observing a side-viewdirection (a second direction) that at least partially differs from thefront-view direction (the first direction) and includes a direction thatintersects the longitudinal direction of the insertion portion 4, thatis, a second region of the object are disposed. The side-viewobservation windows 60 b and 60 c are disposed at equal intervals in acircumferential direction of the distal end portion 6 a, for example, aninterval of 180 degrees. The front-view observation window 60 aconfigures the first object image acquisition section, and at least oneof the side-view observation windows 60 b and 60 c configures the secondobject image acquisition section.

Note that the number of the side-view observation windows 60 b and 60 cwhich are disposed at the equal intervals in the circumferentialdirection of the distal end portion 6 a is not limited to two, but aconfiguration in which one side-view observation window is disposed maybe adopted, for example. Further, as for the side-view observationwindows 60 b and 60 c which are disposed at equal intervals in thecircumferential direction of the distal end portion 6 a, for example, aconfiguration in which the side-view observation windows are disposedevery 120 degrees in the circumferential direction (that is, threeside-view field of view images are acquired), may be adopted, or aconfiguration in which the side-view observation windows are disposedevery 90 degrees in the circumferential direction (that is, fourside-view field of view images are acquired) may be adopted.

On the distal end face of the distal end portion 6 a of the endoscope 2a, front-view illuminating windows 61 a and 62 a that emit illuminatinglight to a range of a front-view field of view of the front-viewobservation window 60 a are disposed in positions adjacent to thefront-view observation window 60 a. Further, on side face of the distalend portion 6 a of the endoscope 2 a, side-view illuminating windows 61b and 62 b that emit illuminating light to a range of a side-view fieldof view of the side-view observation window 60 b are disposed inpositions adjacent to the side-view observation window 60 b, andside-view illuminating windows 61 c and 62 c that emit illuminatinglight to a range of a side-view field of view of the side-viewobservation window 60 c are disposed in positions adjacent to theside-view observation window 60 c. A distal end opening portion 63 fromwhich a treatment instrument 64 protrudes is provided at a rear side ofthe side-view observation window 60 b on the side face of the distal endportion 6 a.

Note that as light exit sections that emit illuminating light from thefront-view illuminating windows 61 a and 62 a, the side-viewilluminating windows 61 b and 62 b, and the side-view illuminatingwindows 61 c and 62 c, light emitting devices such as light guides orlight emitting diodes (LED) can be cited.

FIG. 10 is a diagram showing a configuration of an essential part in thesecond embodiment, and FIG. 11A and FIG. 11B are diagrams showingexamples of the observation image including images of the treatmentinstrument which are displayed in the monitors.

As shown in FIG. 10, an image pickup device 65 a is disposed in an imageformation position of the front-view observation window 60 a and anobjective optical system not illustrated. Further, an image pickupdevice 65 b is disposed in an image formation position of the side-viewobservation window 60 b and the objective optical system notillustrated, and an image pickup device 65 c is disposed in an imageformation position of the side-view observation window 60 c and theobjective optical system not illustrated.

The image pickup devices 65 a to 65 c are electrically connected to theimage processing section 32 a of the video processor 32 which has thefunction as the image signal generation section respectively, and outputa front-view field of view image which is picked up by the image pickupdevice 65 a and side-view field of view images which are picked up bythe respective image pickup devices 65 b and 65 c to the imageprocessing section 32 a.

As shown in FIG. 11A, the image processing section 32 a generates animage signal so as to dispose a front-view field of view image 66 a thatis picked up by the image pickup device 65 a in a center of the monitor35, and dispose a side-view field of view image 66 b that is picked upby the image pickup device 65 b and a side-view field of view image 66 cthat is picked up by the image pickup device 65 c side by side in astate where the side-view field of view image 66 b and the side-viewfield of view image 66 c are adjacent to be on both sides of thefront-view field of view image 66 a respectively.

Further, the image processing section 32 a rotationally moves theside-view field of view image 66 b so that the central axis of the image50 of the treatment instrument in the front-view field of view image 66a, and the central axis of the image 51 of the treatment instrument inthe side-view field of view image 66 b substantially correspond to eachother. At this time, the image processing section 32 a also rotationallymoves the side-view field of view image 66 c by a same moving amount asa rotational moving amount of the side-view field of view image 66 b, inan opposite direction to the side-view field of view image 66 b.

Note that the rotationally moving processing by the image processingsection 32 a is similar to the rotationally moving processing in thefirst embodiment. Further, when a plurality of images are displayed inthe monitor 35, the front-view field of view image and the side-viewfield of view image can be adjacent to each other, and the configurationis not limited to only the configuration in which the side-view field ofview images 66 b and 66 c are disposed on both sides of the front-viewfield of view image 66 a, but may be a configuration in which theside-view field of view image, for example, only the side-view field ofview image 66 b in which the image 51 of the treatment instrument isdisplayed, is disposed at either one of left or right side of thefront-view field of view image 66 a.

Further, in the present embodiment, a plurality of images are displayedin the monitor 35, but the present invention is not limited to this. Forexample, as shown in FIG. 11B, like a configuration in which aplurality, for example, three of the monitors 35 are disposed adjacentlyto one another, the front-view field of view image 66 a is displayed inthe central monitor 35, and the side-view field of view images 66 b and66 c are respectively displayed in the monitors 35 at both sides, aconfiguration in which the monitor 35 displaying the front-view field ofview image and the monitors 35 displaying the side-view field of viewimages are adjacent to one another may be adopted.

As above, even in the configuration in which the front-view observationwindow 60 a which acquires the front-view field of view image isprovided on the distal end face of the distal end portion 6 a, theplurality of side-view observation windows 60 b and 60 c that acquireside-view field of view images are provided in the circumferentialdirection of the distal end portion 6 a, and the plurality of images(the front-view field of view image 66 a, and the side-view field ofview images 66 b and 66 c) are displayed in the monitor 35, the centralaxes of the image 50 of the treatment instrument in the front-view fieldof view image 66 a and the image 51 of the treatment instrument in theside-view field of view image 66 b also can be caused to substantiallycorrespond to each other.

As a matter of course, as in the first embodiment, the image of theobject is not limited to the image of the treatment instrument, and maybe an image of another element observed in the field of view.

Consequently, according to the endoscope system 1 of the presentembodiment, the objects (the images of the treatment instrument or thelike) within the field of view observed in the front-view field of viewand the side-view field of view are caused to be adjacent to each otherwithout unnaturalness in such a manner as to be caused to continue toeach other, without time and effort in manufacturing and working anendoscope being increased, whereby workability of treatment by thetreatment instrument under the wide-angle endoscope can be enhanced.

Third Embodiment

Next, a third embodiment will be described.

An endoscope system of the present embodiment has a similarconfiguration to the configuration of the first embodiment, and differsfrom the first embodiment in the configuration of the image processingsection 32 a.

FIG. 12 is a diagram for explaining a configuration of an imageprocessing section according to the third embodiment, FIG. 13A to FIG.13C are diagrams showing examples of an observation image includingimages of the treatment instrument displayed in the monitor. Note thatin FIG. 12, the same components as the components in FIG. 6 are assignedwith the same reference signs and explanation will be omitted.

As shown in FIG. 12, the image processing section 32 a of the presentembodiment is configured by including an image enlargement/reductionratio calculation section 70 in place of the image movement amountcalculation section 43 in FIG. 6.

The image enlargement/reduction ratio calculation section 70 detects aproximal end of the image 50 of the treatment instrument in thefront-view field of view image, and a distal end of the image 51 of thetreatment instrument in the side-view field of view image respectivelyfrom predetermined objects, for example, the central axis of the image50 of the treatment instrument in the front-view field of view image,and the central axis of the image 51 of the treatment instrument in theside-view field of view image which are recognized by the central axisrecognition section 42. Subsequently, the image enlargement/reductionratio calculation section 70 calculates an enlargement/reduction ratioof the front-view field of view image or the side-view field of viewimage, with which the proximal end of the image 50 of the treatmentinstrument in the front-view field of view image and the distal end ofthe image 51 of the treatment instrument of the side-view field of viewimage which are detected substantially correspond to each other.

The image generation section 44 changes a display magnification of thefront-view field of view image or the side-view field of view imagelongitudinally and laterally (distorts the front-view field of viewimage or the side-view field of view image) so that the proximal end ofthe image 50 of the treatment instrument in the front-view field of viewimage and the distal end of the image 51 of the treatment instrument inthe side-view field of view image which are detected substantiallycorrespond to each other, on the basis of the enlargement/reductionratio which is calculated by the image enlargement/reduction ratiocalculation section 70.

Note that when the image generation section 44 changes the displaymagnification of the side-view field of view image longitudinally andlaterally, for example, the image generation section 44 changes themagnification of only a vicinity of the image 51 of the treatmentinstrument, instead of changing the magnification of the entireside-view field of view image. Thereby, an image of the vicinity of theimage 51 of the treatment instrument is changed, and thereby aninfluence is not given to a deviation of the entire image.

Further, the image generation section 44 may change the displaymagnifications of the front-view field of view image and the side-viewfield of view image longitudinally and laterally. The magnifications ofboth of the field of view images are changed in this way, wherebydistortion amounts of the respective field of view images decrease, andunnaturalness due to distortion can be reduced.

In FIG. 13A, for example, the display magnification of the front-viewfield of view image is changed longitudinally and laterally, and theproximal end of the image 50 of the treatment instrument in thefront-view field of view image and the distal end of the image 51 of thetreatment instrument in the side-view field of view image are caused tosubstantially correspond to each other. Further, in FIG. 13B, thedisplay magnification of the side-view field of view image is changedlongitudinally and laterally, and the proximal end of the image 50 ofthe treatment instrument in the front-view field of view image and thedistal end of the image 51 of the treatment instrument in the side-viewfield of view image are caused to substantially correspond to eachother. Further, in FIG. 13C, the display magnifications of thefront-view field of view image and the side-view field of view image arechanged longitudinally and laterally, and the proximal end of the image50 of the treatment instrument of the front-view field of view image andthe distal end of the image 51 of the treatment instrument of theside-view field of view image are caused to substantially correspond toeach other.

Next, an operation of the endoscope system 1 that is configured as abovewill be described.

FIG. 14 is a flowchart for explaining an example of image processing bythe image processing section of the third embodiment. Note that in FIG.14, the same processings as in FIG. 8 are assigned with the samereference signs, and explanation will be omitted. Further, in theflowchart in FIG. 14, an example in which the display magnification ofthe side-view field of view image is changed longitudinally andlaterally is explained, but the display magnification of the front-viewfield of view image may be changed longitudinally and laterally, or thedisplay magnifications of the front-view field of view image and theside-view field of view image may be changed longitudinally andlaterally, as described above.

When the central axis of the image of the treatment instrument observedin the front-view field of view is calculated in step S5, the imageenlargement/reduction ratio calculation section 70 detects the proximalend of the image of the treatment instrument of the front-view field ofview image, and the distal end of the image of the treatment instrumentof the side-view field of view image (step S11). Next, the imageenlargement/reduction ratio calculation section 70 calculates theenlargement/reduction ratio of the image of the treatment instrumentobserved in the side-view field of view, that substantially correspondsto the proximal end of the image of the treatment instrument observed inthe front-view field of view (step S12).

Next, when only the side-view field of view image is recognized and onlythe side-view field of view image is cut out in step S7, the imagegeneration section 44 changes the display magnification of the side-viewfield of view image longitudinally and laterally so that the proximalend of the image of the treatment instrument in the front-view field ofview image and the distal end of the image of the treatment instrumentin the side-view field of view image substantially correspond to eachother (step S13). Finally, the image generation section 44 generates animage signal with the proximal end of the image of the treatmentinstrument in the front-view field of view image and the distal end ofthe image of the treatment instrument in the side-view field of viewimage substantially corresponding to each other (step S14), and ends theprocessing. The image signal which is generated in this way is displayedin the monitor 35 via the image output section 32 b.

As above, the endoscope system 1 detects a deviation between the imageof the treatment instrument in the front-view field of view image andthe image of the treatment instrument in the side-view field of viewimage, causes the magnification of only the vicinity of the image of thetreatment instrument in the front-view field of view image or theside-view field of view image to be changed in accordance with an amountof the deviation, and causes the proximal end of the image of thetreatment instrument in the front-view field of view image and thedistal end of the image of the treatment instrument in the side-viewfield of view image to substantially correspond to each other. Thereby,the images of the treatment instrument in the front-view field of viewimage and the side-view field of view image are connected continuously,and therefore visibility and operability of the treatment instrument canbe enhanced.

Consequently, according to the endoscope system of the presentembodiment, similar effects to the effects of the first embodiment areprovided, and since only the magnification of the vicinity of the imageof the treatment instrument in the front-view field of view image or theside-view field of view image is changed, an influence is not given to adeviation of the entire image.

Fourth Embodiment

Next, a fourth embodiment will be described.

A configuration of the image processing section 32 a of the presentembodiment is similar to the configuration of the image processingsection 32 a of the first embodiment in FIG. 6, and only processingdifferent from the processing of the image processing section 32 a ofthe first embodiment will be described.

The image movement amount calculation section 43 detects the proximalend of the image 50 of the treatment instrument in the front-view fieldof view image, and the distal end of the image 51 of the treatmentinstrument in the side-view field of view image, and calculates such animage movement amount that allows the proximal end and the distal end tosubstantially correspond to each other.

The image generation section 44 moves a coordinate position of thefront-view field of view image or the side-view field of view imagebased on the image movement amount calculated in the image movementamount calculation section 43.

FIG. 15A and FIG. 15B are diagrams showing an example of an observationimage including images of the treatment instrument displayed in themonitor.

In the example in FIG. 15A and FIG. 15B, coordinates of the front-viewfield of view image are moved diagonally downward to a left when viewedfrom the front of the drawings, whereby the central axes of the image 50of the treatment instrument in the front-view field of view image andthe image 51 of the treatment instrument in the side-view field of viewimage substantially correspond to each other. Note that the image thecoordinates of which are moved is not limited to the front-view field ofview image, but the coordinates of the side-view field of view image maybe moved, or the coordinates of both of the front-view field of viewimage and the side-view field of view image may be moved.

Next, an operation of the endoscope system configured as above will bedescribed.

FIG. 16 is a flowchart for explaining an example of image processing bythe image processing section of the fourth embodiment. Note that in FIG.16, the processings similar to the processings in FIG. 8 are assignedwith the same reference signs, and explanation will be omitted. Further,in the flowchart in FIG. 16, an example in which the coordinates of theside-view field of view image are moved is described, but thecoordinates of the front-view field of view image may be moved, or thecoordinates of the front-view field of view image and the side-viewfield of view image may be moved, as described above.

When the central axis of the image of the treatment instrument observedin the front-view field of view is calculated in step S5, the imagemovement amount calculation section 43 detects the proximal end of theimage of the treatment instrument in the front-view field of view image,and the distal end of the image of the treatment instrument in theside-view field of view image (step S21). Next, the image movementamount calculation section 43 calculates such a movement amount of theside-view field of view image that allows the proximal end of the imageof the treatment instrument observed in the front-view field of view andthe distal end of the image of the treatment instrument observed in theside-view field of view to substantially correspond to each other (stepS22).

Next, when only the side-view field of view image is recognized and onlythe side-view field of view image is cut out in step S7, the imagegeneration section 44 moves the coordinates of the side-view field ofview image so that the proximal end of the image of the treatmentinstrument in the front-view field of view image and the distal end ofthe image of the treatment instrument in the side-view field of viewimage substantially correspond to each other (step S23). Finally, theimage generation section 44 generates an image signal with the proximalend of the image of the treatment instrument in the front-view field ofview image and the distal end of the image of the treatment instrumentin the side-view field of view image substantially corresponding to eachother (step S24), and ends the processing. The image signal which isgenerated in this way is displayed in the monitor 35 via the imageoutput section 32 b.

As above, the endoscope system 1 detects a deviation between the imageof the treatment instrument in the front-view field of view image andthe image of the treatment instrument in the side-view field of viewimage, moves the coordinates of the front-view field of view image orthe side-view field of view image in accordance with an amount of thedeviation, and causes the proximal end of the image of the treatmentinstrument in the front-view field of view image and the distal end ofthe image of the treatment instrument in the side-view field of viewimage to substantially correspond to each other. Thereby, the centralaxes of the images of the treatment instrument in the front-view fieldof view image and the side-view field of view image substantiallycorrespond to each other, and therefore visibility and operability ofthe treatment instrument can be enhanced.

Consequently, according to the endoscope system of the presentembodiment, similar effects to the effects of the first embodiment areprovided. Since the coordinates displaying the front-view field of viewimage or the side-view field of view image are only changed, distortionand the image which is seen do not have to be changed, and visibilityand operability of the treatment instrument can be further enhanced.

Fifth Embodiment

Next, a fifth embodiment will be described.

A configuration of the image processing section 32 a of the presentembodiment is similar to the configuration of the image processingsection 32 a of the third embodiment in FIG. 12, and only processingdifferent from the processing of the image processing section 32 a ofthe third embodiment will be described.

The image enlargement/reduction ratio calculation section 70 calculatesan enlargement ratio of the image 51 of the treatment instrument in theside-view field of view image, which overlaps the central axis of theimage 50 of the treatment instrument in the front-view field of viewimage, from the central axis of the image 50 of the treatment instrumentin the front-view field of view image, and the central axis of the image51 of the treatment instrument in the side-view field of view image,which are recognized by the central axis recognition section 42 for theimage of the treatment instrument.

The image generation section 44 cuts out only the image 51 of thetreatment instrument in the side-view field of view image from theside-view field of view image, and enlarges the image 51 of thetreatment instrument in the side-view field of view image on the basisof the enlargement ratio calculated in the image enlargement/reductionratio calculation section 70.

FIG. 17A and FIG. 17B are diagrams showing an example of an observationimage including images of the treatment instrument displayed in themonitor.

In the example in FIG. 17A and FIG. 17B, only the image 51 of thetreatment instrument in the side-view field of view image is enlarged,so that the image 51 of the treatment instrument in the side-view fieldof view image overlaps the central axis of the image 50 of the treatmentinstrument in the front-view field of view image. Note that the image ofthe treatment instrument which is enlarged is not limited to the image51 of the treatment instrument in the side-view field of view image, butthe image 50 of the treatment instrument in the front-view field of viewimage may be enlarged, or both of the image 50 of the treatmentinstrument in the front-view field of view image and the image 51 of thetreatment instrument in the side-view field of view image may beenlarged.

Next, an operation of the endoscope system that is configured as abovewill be described.

FIG. 18 is a flowchart for explaining an example of image processing bythe image processing section of the fifth embodiment. Note that in FIG.18, the processings similar to the processings in FIG. 8 are assignedwith the same reference signs, and explanation will be omitted. Further,in the flowchart in FIG. 18, an example of enlarging the image of thetreatment instrument in the side-view field of view image is described,but the image of the treatment instrument in the front-view field ofview image may be enlarged, or the images of the treatment instrument inthe front-view field of view image and the side-view field of view imagemay be enlarged, as described above.

When the central axis of the image of the treatment instrument observedin the front-view field of view is calculated in step S5, the imageenlargement/reduction ratio calculation section 70 calculates anenlargement ratio of the image of the treatment instrument in theside-view field of view image, with which the central axis of the imageof the treatment instrument observed in the front-view field of view,and the image of the treatment instrument observed in the side-viewfield of view overlap each other (step S31).

Next, the image generation section 44 recognizes only the side-viewfield of view image, and cuts out only the image of the treatmentinstrument in the side-view field of view image (step S32).Subsequently, the image generation section 44 enlarges the image of thetreatment instrument in the side-view field of view image so that thecentral axis of the image of the treatment instrument in the front-viewfield of view image and the image of the treatment instrument in theside-view field of view image overlap each other (step S33). Finally,the image generation section 44 generates an image signal with thecentral axis of the image of the treatment instrument in the front-viewfield of view image, and the image of the treatment instrument in theside-view field of view image overlapping each other (step S34), andends the processing. The image signal which is generated in this way isdisplayed in the monitor 35 via the image output section 32 b.

As above, the endoscope system 1 detects a deviation between the imageof the treatment instrument in the front-view field of view image andthe image of the treatment instrument in the side-view field of viewimage, and changes the enlargement ratio of the image of the treatmentinstrument in the front-view field of view image or the side-view fieldof view image in accordance with an amount of the deviation.Subsequently, the endoscope system 1 causes the image of the treatmentinstrument in the front-view field of view image and the central axis ofthe image of the treatment instrument in the side-view field of viewimage to overlap each other, or causes the central axis of the image ofthe treatment instrument in the front-view field of view image and theimage of the treatment instrument in the side-view field of view imageto overlap each other. Thereby, the image of the treatment instrument inthe front-view field of view image and the image of the treatmentinstrument in the side-view field of view image substantially correspondto each other, and therefore visibility and operability of the treatmentinstrument can be enhanced.

Consequently, according to the endoscope system of the presentembodiment, similar effects to the effects of the first embodiment areprovided. Since the enlargement ratio of only a portion of the image ofthe treatment instrument is changed, processing for the entire screendoes not have to be performed as compared with the aforementionedrespective embodiments, and a load of the image processing can bereduced.

Note that the endoscope system 1 of the second embodiment in which aplurality of images are disposed adjacently to each other in the monitor35 may be applied to the endoscope systems 1 of the third embodiment tothe fifth embodiment. FIG. 19A to FIG. 19E are diagrams showing examplesof screen display at a time of the endoscope system of the secondembodiment being applied to the endoscope systems of the thirdembodiment to the fifth embodiment.

FIG. 19A is an example in which the endoscope system 1 of the secondembodiment is applied to the endoscope system 1 of the third embodiment.As shown in FIG. 19A, the image 51 of the treatment instrument in theside-view field of view image 66 b is distorted, and the central axis ofthe image 50 of the treatment instrument in the front-view field of viewimage 66 a and the central axis of the image 51 of the treatmentinstrument in the side-view field of view image 66 b are caused tosubstantially correspond to each other.

Further, FIG. 19B is an example in which the endoscope system 1 of thesecond embodiment is applied to the endoscope system 1 of the fourthembodiment. As shown in FIG. 19B, a coordinate position of the side-viewfield of view image 66 b is changed (the side-view field of view image66 b is subjected to parallel translation), and the proximal end of theimage 50 of the treatment instrument in the front-view field of viewimage 66 a and the distal end of the image 51 of the treatmentinstrument in the side-view field of view image 66 b are caused tosubstantially correspond to each other.

At this time, the side-view field of view image 66 b and an areadisplaying the side-view field of view image 66 b may be simultaneouslysubjected to parallel translation, but a setting may be adopted, inwhich the area displaying the side-view field of view image 66 b is notmoved, and only the side-view field of view image 66 b is subjected toparallel translation.

Further, FIG. 19C is an example in which the endoscope system 1 of thesecond embodiment is applied to the endoscope system 1 of the fifthembodiment. As shown in FIG. 19C, only the image 51 of the treatmentinstrument in the side-view field of view image is enlarged, and thecentral axis of the image 50 of the treatment instrument in thefront-view field of view image 66 a and the image 51 of the treatmentinstrument in the side-view field of view image 66 b are caused tosubstantially correspond to each other.

Further, FIG. 19D is an example in which the endoscope system 1 of thesecond embodiment is applied to the endoscope system 1 in which thethird, the fourth and the fifth embodiments are combined, and FIG. 19Eis an example in which duplicated portions are deleted from the imagesignal, and the image signal is displayed.

As shown in FIG. 19D, parallel translation shown in FIG. 19B isperformed, and deformation and enlargement processing shown in FIG. 19Aand FIG. 19C may be combined with the parallel translation. Further, inthe case of the embodiment in which a plurality of screens are displayedlike this, if duplicated portions are generated in two adjacent imagesignals, the video processor 32 may delete the duplicate portions fromthe image signals, and allow the image signals be displayed (refer toFIG. 19E).

Further, in each of the second embodiment and the respectivemodifications described above, the mechanisms which realize thefunctions of illuminating and observing a sideward side are incorporatedin the distal end portion 6 of the insertion portion 4 together with themechanisms that realize the functions of illuminating and observing aforward side, but the mechanisms which realize the functions ofilluminating and observing the sideward side may be made separate bodiesattachable to and detachable from the insertion portion 4.

FIG. 20 is a perspective view of the distal end portion 6 of theinsertion portion 4 to which a unit for sideward side observation isattached. The distal end portion 6 of the insertion portion 4 has aforward side view unit 100. A sideward side view unit 110 has aconfiguration attachable to and detachable from the forward side viewunit 100 by a clip portion 111.

The sideward side view unit 110 has two observation windows 112 foracquiring images in a lateral direction, and two illuminating windows113 for illuminating the lateral direction.

The video processor 32 or the like performs lighting and extinguishingof the respective illuminating windows 113 of the sideward side viewunit 110 in accordance with a frame rate of a forward side field ofview, and can perform acquisition and display of the observation imageas shown in the above described embodiments.

Sixth Embodiment

Next, a sixth embodiment will be described.

FIG. 21 is a diagram showing a configuration of an essential part in thesixth embodiment. Note that in FIG. 21, the similar components to thecomponents in FIG. 5 are assigned with the same reference signs, andexplanation will be omitted.

As shown in FIG. 21, the video processor 32 is configured by a settingstorage section 32 c being added to the video processor in FIG. 5.

In each of the respective embodiments described above, at the time oftreatment by the treatment instrument (that is, when the treatmentinstrument is observed by the endoscope 2), the deviation amount betweenthe image 50 of the treatment instrument in the front-view field of viewimage and the image 51 of the treatment instrument in the side-viewfield of view image is calculated, and image correction is performed.

In contrast to the above, in the present embodiment, the treatmentinstrument is protruded from the distal end opening portion 17 afterassembly of the endoscope 2, instead of at the time of treatment by thetreatment instrument, and the deviation amount between the image of thetreatment instrument in the front-view field of view image and the imageof the treatment instrument of the side-view field of view image iscalculated for each of the endoscopes 2 in advance. Subsequently, thesetting storage section 32 c stores the deviation amount calculatedafter assembly of the endoscope 2 as endoscope information.

The image processing section 32 a subjects the front-view field of viewimage or the side-view field of view image to image correction on thebasis of the endoscope information (the deviation amount) which isstored in the setting storage section 32 c in advance at the time ofendoscope observation. As the image correction, any of image correctionsin the aforementioned respective embodiments can be used.

As above, the endoscope system 1 stores the deviation amount in each ofthe endoscopes 2 in the setting storage section 32 c as the endoscopeinformation in advance, and performs image correction by using theendoscope information, whereby the endoscope system 1 can cause theimage 50 of the treatment instrument in the front-view field of viewimage and the image 51 of the treatment instrument in the side-viewfield of view image to substantially correspond to each other, as in theaforementioned respective embodiments. Furthermore, since the endoscopesystem 1 performs image correction by using the endoscope informationwhich is stored in the setting storage section 32 c in advance, theendoscope system 1 can display the front-view field of view image andthe side-view field of view image with the deviation amount corrected,in the monitor 35, even in a state where the endoscope system 1 does notrecognize the image of the treatment instrument, that is, in a statewhere treatment is not performed by using the treatment instrument.

Consequently, according to the endoscope system of the presentembodiment, effects similar to the effects of the first embodiment areprovided, and even in the state where the image of the treatmentinstrument is not recognized, the front-view field of view image and theside-view field of view image with the deviation amount corrected can bedisplayed in the monitor 35.

Note that image correction may be automatically turned on or off inresponse to presence and absence of insertion of the treatmentinstrument, or a changeover switch or the like is provided, and imagecorrection may be enabled to be turned on or off manually. The switchingof image correction also can be similarly applied to the firstembodiment to the fifth embodiment described above.

Note that as for the respective steps in the flowcharts in the presentdescription, execution sequences may be changed, a plurality of stepsmay be simultaneously executed, or the respective steps may be executedin a different sequence at each execution, as long as it is not againstthe characteristics of the respective steps.

The present invention is not limited to the aforementioned embodiments,and various modifications, alterations and the like can be made withinthe range without departing from the gist of the present invention.

What is claimed is:
 1. An endoscope system, comprising: an insertionportion that is inserted to an inside of an object; a first object imageacquisition section that is provided in the insertion portion, andacquires a first object image including an image of a predeterminedobject, from a first region of the object; a second object imageacquisition section that is provided in the insertion portion, andacquires a second object image including the image of the object, from asecond region of the object, which at least partially differs from thefirst region; an image signal generation section that generates a signalof an image in which the first object image and the second object imageare disposed side by side so as to be adjacent to each other; arecording section that records information on a deviation amountconcerning a deviation of disposition of the image of the object in thefirst object image, and disposition of the image of the object in thesecond object image, in the image; and an image processing section thatperforms, for the image, processing of changing disposition of at leasteither the image of the object in the first object image and the imageof the object in the second object image in accordance with thedeviation amount, and aligning a position of the image of the object inthe first object image, and a position of the image of the object in thesecond object image with each other.
 2. The endoscope system accordingto claim 1, further comprising: a calculation section that calculatesthe deviation amount concerning a deviation of disposition of the imageof the object in the first object image, and disposition of the image ofthe object in the second object image, in the image.
 3. The endoscopesystem according to claim 1, wherein the image processing sectiondetects a first center axis of the image of the object included in thefirst object image, and a second center axis of the image of the objectincluded in the second object image, and performs, for the image,processing of changing disposition with respect to at least one of thefirst object image and the second object image so that the first and thesecond center axes substantially correspond to each other.
 4. Theendoscope system according to claim 3, wherein the image processingsection performs, for the image, processing of rotationally moving atleast one of the first object image and the second object image.
 5. Theendoscope system according to claim 4, wherein the image processingsection calculates an opening angle between the first center axis andthe second center axis, and performs, for the image, processing ofrotationally moving either the first object image or the second objectimage so that the first and the second center axes substantiallycorrespond to each other.
 6. The endoscope system according to claim 3,wherein the image of the object included in the first and the secondobject images is an image of a treatment instrument that is protrudedfrom a distal end of the insertion portion.
 7. The endoscope systemaccording to claim 4, wherein the image processing section performs, forthe image, processing of further performing parallel translation orchange of a magnification ratio with respect to at least one of thefirst object image and the second object image, and aligning an endportion of the image of the object in the first object image and an endportion of the image of the object in the second object image with eachother.
 8. The endoscope system according to claim 1, further comprising:one or a plurality of display sections displaying an image signal thatis outputted from the image signal generation section, is processed inthe image processing section, and includes the first object image andthe second object image.
 9. The endoscope system according to claim 8,wherein the image signal generation section outputs respective imagesignals from which duplicate regions of an image signal based on thefirst object image and an image signal based on the second object imageare removed, to the monitor.
 10. The endoscope system according to claim1, wherein the first object image is an object image in the first regionincluding a frontward side of the insertion portion substantiallyparallel with a longitudinal direction of the insertion portion, thesecond object image is an object image in the second region including asideward side of the insertion portion in a direction intersecting thelongitudinal direction of the insertion portion, the first object imageacquisition section is a forward side image acquisition section thatacquires the object image in the first region, and the second objectimage acquisition section is a sideward side image acquisition sectionthat acquires the object image in the second region.
 11. The endoscopesystem according to claim 4, wherein the image processing sectionperforms, for the image, processing of changing at least a rotationdirection of the entire first and second object images, with a center ofthe first object image as a reference.
 12. The endoscope systemaccording to claim 1, wherein the second object image acquisitionsection is disposed in plurality at substantially equal angles in acircumferential direction of the insertion portion, and the image signalgeneration section generates an image signal with the first object imagedisposed in a center, and the second object image in plurality disposedat substantially equal angles in a circumferential direction of thefirst object image.
 13. The endoscope system according to claim 1,wherein the first object image acquisition section is disposed at adistal end portion in a longitudinal direction of the insertion portionto face a direction in which the insertion portion is inserted, thesecond object image acquisition section is disposed at a side face ofthe insertion portion to face a circumferential direction of theinsertion portion, and a first image pickup section thatphotoelectrically converts the first object image from the first objectimage acquisition section, and a second image pickup section thatphotoelectrically converts the second object image from the secondobject image acquisition section are separately provided, and the firstimage pickup section and the second image pickup section areelectrically connected to the image signal generation section.
 14. Theendoscope system according to claim 1, wherein the first object imageacquisition section is disposed at a distal end portion in alongitudinal direction of the insertion portion, in a direction in whichthe insertion portion is inserted, and the second object imageacquisition section is disposed to surround a circumferential directionof the insertion portion, the endoscope system further comprising: animage pickup section that is disposed to photoelectrically convert thefirst object image from the first object image acquisition section andthe second object image from the second object image acquisition sectionon a same plane, and is electrically connected to the image signalgeneration section.
 15. The endoscope system according to claim 14,wherein the image signal generation section generates an image signalwith the first object image formed in a substantially circular shape,and the second object image formed in a substantially circular ringshape surrounding a circumference of the first object image.